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ABSTRACT 
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interviews. Researchers examined eligibility criteria; public and voucher 
student and school characteristics; public and voucher student racial 
composition and changes in composition related to vouchers; voucher program 
funding and amounts spent on public versus voucher students; and academic 
achievement. The two voucher programs had similar eligibility criteria. 
Voucher family characteristics and voucher school attributes differed from 
those of public school families and public schools. Minority students 
predominated school populations, but whether voucher programs changed 
schools' racial composition was unclear. States funded voucher programs 
differently and spent less on voucher students than public school students. 
Some research saw little significant improvement in voucher students ' 
achievement, while other research found some positive effects. Six appendices 
examine scope and methodology; publicly funded school voucher programs in 
Florida, Maine, and Vermont; additional data on racial and ethnic composition 
of Cleveland schools; strengths and limitations of studies analyzing 
Cleveland and Milwaukee students' academic achievement; and General 
Accounting Office contacts and staff acknowledgements. (Contains 23 
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GAO 

Accountability * Integrity * Reliability 

United States General Accounting Office 
Washington, DC 20548 



August 31, 2001 

The Honorable Judd Gregg 
United States Senate 

Dear Senator Gregg: 

School voucher programs have generated considerable debate nationwide. 
Only three states — Florida, Ohio, and Wisconsin — have initiated programs 
within the last decade to provide public funding that allows families to 
send their children to private elementary and secondary schools. These 
states created their voucher programs largely in reaction to state and 
parental dissatisfaction with the quality of public schools. Opinions vary 
widely about whether voucher programs are a viable solution to public 
school problems. Some advocates have claimed that voucher programs 
will provide poor families with educational choices like those available to 
affluent families and will promote greater competition among schools, 
forcing them to become more effective in order to remain viable. 
Opponents have stressed that voucher programs will hurt public school 
funding by steering tax dollars to private schools, and that evidence of 
student achievement gains is inconclusive. Opponents have also warned of 
the potential for increased segregation by race and income as voucher 
schools may attract the best students from the traditional public schools. 

You indicated your interest in both publicly and privately funded school 
voucher programs. For this report you requested that we provide 
information on the publicly funded school voucher programs in Cleveland 
and Milwaukee, primarily based on research conducted on these 
programs. 1 As of the 1999-2000 school year, the Cleveland program had 
about 3,400 voucher students enrolled in 52 private schools, and the 
Milwaukee program had about 7,600 students enrolled in 91 private 
schools. We focused our work on answering the following questions: 



'We were asked to focus on the publicly funded Ohio and Wisconsin voucher programs 
because the Florida voucher program, with first-year implementation in the 1999-2000 
school year, was too new for our review. In addition, we did not include the publicly 
funded voucher programs in Maine and Vermont because those programs primarily focus 
on rural communities without adequate public school capacity. While this review was not 
intended to include privately funded voucher programs, such as those in the District of 
Columbia, New York City, Dayton, and San Antonio, we do plan to review such programs. 
We are aware that several studies of these privately funded voucher programs have been 
conducted. 
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• What are the key eligibility criteria for student and private school 
participation in the Cleveland and Milwaukee voucher programs? 

• How does research characterize students and private schools participating 
in these voucher programs compared to public schools and their students 
in the two cities? 

• What is known about the racial composition of public school and voucher 
students and whether this composition has changed as a result of the 
voucher programs? 

• What is known about how these voucher programs are funded and the 
amount spent on public school students compared to the amount spent on 
voucher students? 

• What is known about student academic achievement within these voucher 
programs? 

Most of the data we used to address these questions were collected from 
studies of the Cleveland and Milwaukee voucher programs. We selected 
studies for review that met two or more of the following criteria: (1) were 
performed under contract to Ohio or Wisconsin state departments of 
education; (2) had been published in a peer-reviewed journal; (3) had been 
issued by a research institution that reviews work prior to release; or (4) 
employed quantitative analysis to examine student academic achievement. 
The studies we selected included assessments of the student and school 
characteristics, racial and ethnic composition of public school and 
voucher students, and evaluations of Cleveland and Milwaukee students’ 
academic achievement. We examined the studies to determine if the data 
they contained met criteria for reliability and completeness and if analyses 
of the voucher programs’ effects employed impact evaluation methods, 
such as the use of comparison groups and multivariate analysis 
procedures. We did not include data in our analyses from studies that did 
not meet our criteria. In addition to these studies, we reviewed state laws 
and regulations, school district and voucher program office records, state 
budget data, and a variety of school voucher-related reports and articles. 
We conducted site visits to Ohio and Wisconsin and interviewed officials 
from the state departments of education, the administering program 
offices, the public school districts, and several private schools. Appendix I 
further describes our scope and methodology. A list of the studies we 
reviewed is provided in the bibliography to this report. We conducted our 
review between February and July 2001 in accordance with generally 
accepted government auditing standards. 



Results in Brief 



State laws and regulations govern the participation of students and 
schools in the Cleveland and Milwaukee programs. Both programs were 
primarily designed to provide educational opportunity for students of low- 
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income families residing within the Cleveland school district or the city of 
Milwaukee and are similar in their design. In Cleveland, priority is given to 
students from families whose income is less than 200 percent of federal 
poverty guidelines. However, if low-income Cleveland students do not use 
all available vouchers, students above the low-income guidelines may use 
the remaining vouchers. For Milwaukee, all students must come from 
families whose incomes do not exceed 175 percent of federal poverty 
guidelines. Both programs require participating private schools to be 
located within the city or the city’s school district and to adhere to state 
standards for private schools, such as those covering health and safety. 
These schools must also agree to use random selection processes to 
determine voucher student enrollment when student applications exceed 
available slots at specific schools. 

Among the research reports addressing student characteristics, the most 
commonly reported data (excluding race) focused on family income, the 
family’s living arrangement, and parents’ education. In both Cleveland and 
Milwaukee, voucher students were more likely than public school students 
to come from families that had less income and were headed by a parent 
who was single or not married to the person he or she were living with. 2 
Voucher students’ parents in Cleveland and mothers in Milwaukee were 
also more likely to have completed at least high school than were public 
school students’ parents. Some research for Milwaukee also provided 
reliable information on students’ academic achievement prior to their 
participation in a voucher program. Researchers found that voucher 
schools in Milwaukee were attracting lower-performing public school 
students. Data that addressed school characteristics showed that 
Cleveland voucher schools, compared to public schools, had less- 
experienced teachers and smaller class sizes. No comparable school 
characteristics data were collected by the contract researchers for the 
Milwaukee program. Other data indicate that the majority of participating 
voucher schools were religious in Cleveland since the program’s inception, 
whereas the majority have been religious in Milwaukee since the 1998-99 
school year, when religious schools were first admitted to the program. 

Some information about the racial and ethnic composition of Cleveland’s 
and Milwaukee’s public school and voucher students is available, but 



2 In Cleveland, a sample of voucher and public school student families was surveyed, 
whereas in Milwaukee, all voucher and a sample of public school student families were 
surveyed. The survey of Cleveland families during the 1998-1999 school year met our 
criteria for data reliability, but the 1991 survey of Milwaukee families did not. See our 
report of findings for a discussion of why the data are included. 
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whether the composition changed as a result of the voucher programs is 
unclear. During school year 1998-99, well over two-thirds of the students 
enrolled in Cleveland’s and Milwaukee’s voucher programs and public 
schools were minority group members. Most of the minority students were 
African-American. Although the racial and ethnic composition data for the 

1998- 99 school year are reliable, developing trend data is difficult for a 
variety of reasons. For example, data available from the existing research 
for the first 2 years of Cleveland’s program were unreliable or did not fully 
represent the voucher and public school student population. Prior to 1998- 
99, reliable racial and ethnic composition data for Milwaukee’s voucher 
students were available only for intermittent school years: school years 
1990-91 to 1992-93 and the 1994-95 school year. In addition, studies that 
have analyzed changes in the racial and ethnic composition of voucher and 
public schools did not develop complete explanations of the changes. 

They reached conclusions about the voucher programs’ effect on racial 
composition within voucher schools without considering the full range of 
factors that could account for changes in the composition. 

Ohio and Wisconsin use different methods to provide state funds for the 
Cleveland and Milwaukee voucher programs and spend less on voucher 
students than on public school students. The Cleveland voucher program 
is funded with Disadvantaged Pupil Impact Aid funds up to a limit 
established by the Ohio Legislature. These funds are deducted from the 
Cleveland school district’s share of Disadvantaged Pupil Impact Aid. In the 

1999- 2000 school year, the cost of the voucher program was $6.2 milli on 
Wisconsin funds the Milwaukee voucher program with general state aid 
funds ($38.9 million in 1999-2000) based on the number of students 
participating in the program in a given year. One-half of this amount is 
deducted from the Milwaukee school district’s state revenues; the 
remainder is deducted from all other school districts’ state revenues in 
proportion to the total state revenues authorized for each district. The full 
impact of these funding methods on the public schools is unknown. The 
per-pupil amount expended for the voucher program in Cleveland for the 
1999-2000 school year was $1,832, which included the cost of voucher 
payments and program administration; for Milwaukee, just the cost of 
voucher payments amounted to $5, 106. Both these amounts were less than 
the total respective per-pupil state aid that was provided to the Cleveland 
($4,910) and Milwaukee ($6,011) public school districts. 

The contracted evaluations of voucher students’ academic achievement in 
Cleveland and Milwaukee found little or no difference in voucher and 
public school students’ performance, but studies by other investigators 
found that voucher students did better in some of the subject areas tested. 
None of the findings can be considered definitive because the researchers 
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obtained different results when they used different methods to 
compensate for weaknesses in the data. All of the studies satisfied most of 
the basic criteria for research quality, such as using study designs and data 
analysis methods that isolate the program’s effect, but they suffered from 
missing test score data, low survey response rates, and the loss of students 
from program groups and comparison groups over time. The researchers’ 
different findings likely were due to the different study designs, 
comparison groups and statistical tests they used, and the extent of 
missing data on student characteristics. Additional research will be 
needed to develop findings that are conclusive and generalizable. 



Background 



The Cleveland voucher program is officially called the Cleveland 
Scholarship and Tutoring Program and provides state funding to help 
primarily low-income children in kindergarten through the eighth grade 
attend private schools in Cleveland or to attend public schools in districts 
adjacent to the Cleveland school district. 3 The voucher program was 
implemented in the 1996-97 school year, and only private schools have 
participated in it. Students new to the program generally start in 
kindergarten through the third grade and may have previously attended a 
public or a private school or never attended school. In June 2000, the 
Cleveland program had about 3,400 voucher students enrolled in 52 private 
schools, which received about $5.2 million in publicly funded voucher 
payments for the 1999-2000 school year. 4 By comparison, the Cleveland 
school district in 1999-2000 had about 76,000 students enrolled in its 121 
schools supported by $712 million in total revenues. 5 

In Cleveland, actual voucher payments follow the student to the school 
attended, even when he or she changes schools. Voucher checks are made 
out to the student’s parent or guardian and require endorsement before the 
school can use the funds. These funds are sent to the participating schools 
in two payments. Prior to payment, a voucher payment report is generated 
for each participating school listing all current voucher students. Each 
school verifies this report as accurate or updates it before it is sent to the 



3 In addition to vouchers, the Cleveland program has a tutoring component designed to 
provide additional academic assistance to children who continue to attend Cleveland 
public schools. 

4 The $5.2 million in voucher payments to students does not include about $1 million for the 
cost of voucher program administration. 

5 Of the $712 million in total revenues for the Cleveland school district, $371.9 million was 
from the state of Ohio. 
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Ohio Department of Education’s School Finance Division to be processed 
for payment. For low-income voucher students, the voucher amount is 
limited to 90 percent of school tuition up to a maximum of $2,250. For 
those voucher students who do not come from low-income families, the 
voucher amount is limited to 75 percent of school tuition up to a maximum 
of $1,875. Any payments sent to a voucher school are proportionately 
reduced if a student is not enrolled in the school for the entire period 
covered by the scheduled voucher payment. 

About 90 percent of the Cleveland voucher schools are religious schools. 
The constitutionality of providing state-funded vouchers for attendance at 
religious schools has been challenged in the courts since the program’s 
inception. In December 2000, the U.S. Court of Appeals for the Sixth 
Circuit ruled that the program is unconstitutional because it has the effect 
of advancing religion, and that the program constitutes an endorsement of 
religion and sectarian education in violation of the first amendment. 
Subsequently, the court of appeals decided that the program could 
continue operating while interested parties seek U.S. Supreme Court 
review of the court of appeals’ ruling. 

Two teams have conducted research on the academic achievement of 
students in Cleveland’s voucher program. The first was the contract 
researcher, a team from Indiana University, which was contracted by the 
Ohio Department of Education to conduct a multiyear evaluation of the 
program. The second team, supported by Harvard University’s Program on 
Education Policy and Governance (Harvard researchers), conducted its 
own studies. The contract research team analyzed students’ academic 
achievement in school years 1996-97 and 1997-98, the first 2 years of the 
voucher program. The Harvard team reanalyzed the contract researcher 
team’s data for the first year and 1996-97 data from two additional private 
schools participating in the voucher program. 

The Milwaukee voucher program, officially called the Milwaukee Parental 
Choice Program, provides state funding exclusively for low-income 
children in Milwaukee to attend private schools and was first implemented 
in the 1990-91 school year. Wisconsin initially limited participation to 
nonsectarian private schools, but amended the program to include 
religious schools in 1995. For the 1994-95 school year, 771 full-time 
equivalent voucher students attended 12 nonreligious schools. Following 
legal challenges to the 1995 program revision permitting religious school 
participation, the Wisconsin Supreme Court upheld the revision in 1998, 
and program enrollment tripled when Milwaukee voucher students began 
attending religious schools in 1998-99 school year. Subsequently, the U.S. 
Supreme Court chose not to hear an appeal of the Wisconsin Supreme 



O 



Page 6 



.10 



GAO-0 1-9 14 Publicly Funded Voucher Programs 



